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Introduction 

When  learning  to  perform  a  task  it  is  critical  to  have  opportunities  to  practice  the  required  behaviors.  Hence, 
in  order  to  effectively  execute  a  certain  type  of  mission,  it  is  essential  to  be  able  to  repeatedly  attempt  the 
needed  skills,  such  as  the  correct  communication  patterns  in  air  control,  the  correct  formations  to  use  when 
conducting  a  dismounted  patrol,  or  the  correct  tactics  to  employ  when  conducting  a  Close  Air  Support 
mission.  However,  to  be  maximally  effective,  it  is  also  the  case  that  such  practice  needs  to  be  accompanied 
by  meaningful  feedback  to  guide  learning.  Without  such  feedback,  acquired  skills  may  miss  subtleties  or  at 
worst,  may  even  diverge  from  standard  protocols.  Systems  that  provide  performance  feedback  are  an 
essential  accompaniment  to  environments  for  practice  in  order  to  create  true  training  machines. 

Moreover,  when  considering  how  best  to  measure  performance  for  feedback,  it  is  critical  to  realize  that  there 
are  multiple  classes  of  performance  measurement  that  are  each  essential,  and  unique,  in  their  own  right: 

■  Systems-based  Measures.  Systems-based  measures  allow  trainers  to  measure  aspects  of 
performance  from  the  simulation  data  stream  that  may  be  difficult  to  directly  observe  in  real 
time.  For  instance,  measures  of  weapons  delivery  within  particular  parameters  (airspeed,  dive 
angle,  altitude)  may  be  difficult  for  an  observer  to  rapidly  and  accurately  observe,  making 
systems-based  approaches  ideal  because  the  measurements  can  be  pulled  directly  from  a 
simulator  data  stream. 

■  Observer-based  Measures.  Observer-based  measures  are  a  critical  complement  to  systems-based 
measures  as  they  enable  the  assessment  of  items  that  difficult  to  directly  record.  As  an  example, 
accurate  and  reliable  measures  of  communications  and  teamwork  require  observers,  despite 
substantial  advances  in  automated  assessment.  Furthermore,  Observer-Controllers  continue  to  be 
a  key  component  of  most  military  training. 

■  Self-Report  Measures.  Self-report  measures  as  equally  critical,  for  neither  systems-based 
measures  or  observer-based  measures  alone  can  capture  certain  subjective,  but  equally  essential, 
aspects  of  performance.  Examples  of  these  measures  include  things  like  workload  or  situation 
awareness  that  typically  rely  heavily  on  individual  impressions. 

Given,  then,  the  importance  of  measurement  as  well  as  the  different  classes  of  measurement  that  are 
needed,  there  is  a  requirement  for  systems  that  can  efficiently  collect  and  present  combined  sources  of 
information  for  feedback  during  training.  In  the  work  reported  here,  we  address  this  issue  by  focusing  on 
the  integration  of  systems-based  and  observer-based  measures.  Although  not  addressed  here  given  the 
scope  of  work  reported,  a  similar  strategy  is  being  developed  by  Aptima  for  the  integration  of  self-report 
measures  into  a  cohesive  performance  measurement  and  feedback  toolkit. 

Measurement  Objects  for  Human  Performance  in  Simulations  (MOHPS) 

The  basis  of  the  work  reported  here  is  the  development  of  flexible  system  for  performance  measurement, 
which  Aptima  is  developing  with  NAVAIR  and  PMA-205  as  part  of  the  Measurement  Objects  for 
Human  Performance  in  Simulations  (MOHPS)  project  (e.g.,  Aptima,  Inc.,  2005).  MOHPS  is  designed  to 
provide  a  flexible,  interoperable  measurement  infrastructure,  and  as  such,  it  is  being  developed  to  provide 
an  overall  architecture  that  can  ultimately  encompass  data  capture,  measurement,  assessment,  diagnosis. 
After  Action  Review,  and  configuration  functions  to  map  available  performance  measures  to  specific 
training  instances.  More  specifically,  the  heart  of  the  MOHPS  project  is  the  Performance  Measurement 
Engine  and  the  associated  Performance  Measurement  Objects: 
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■  The  Performance  Measurement  (PM)  Engine  provides  the  capability  to  configure  and  collect 
performance  measures  from  a  simulator.  It  is  the  mechanism  that  connects  to  a  simulator, 
gathers  the  requisite  data,  and  computes  the  performance  measures.  The  PM  Engine  handles  the 
configuration,  collection,  and  computation  of  performance  measures  in  a  stream-lined  manner 
through  direct  use  of  Performance  Measurement  Objects  (PMOs). 

•  PMOs  are  software  objects  in  a  federated  HLA  simulation.  Their  intent  is  to  expand  the  world  of 
HLA  objects  to  include  trainees,  instructors,  teams,  assignments,  performance  measurements, 
and  so  on  by  describing  human  performance  in  a  distributed  virtual  environment.  Specifically, 
PMOs  are  used  to  communicate  between  the  measurement  engine  and  third-party  simulator 
components,  specify  performance  measurement  configuration,  and  compute  actual  performance 
measures.  PMOs  are  specified  in  Aptima’s  Human  Performance  Measurement  Language 
(HPML).  HPML  is  a  platform-neutral  medium  for  specifying  PMOs  that  is  universally  machine- 
readable  and  easily  decipherable  (because  it  is  XML-based).  Importantly,  HPML  is  not  a 
programming  language  -  It  is  designed  to  express  simple  computations,  referencing  function 
libraries  for  more  complex  computations. 

Collectively,  MOHPS  provides  a  method  to  develop  and  record  performance  measures  that  can  be  tied  to 
a  variety  of  simulations  to  ultimately  provide  feedback,  and  in  particular,  the  MOHPS  project  is  focused 
on  developing  the  capability  to  handle  systems-based  measures. 

Integration  of  Systems-based  and  Observer-based  Measures 

Building  on  this  MOHPS  capability,  as  part  of  follow-on  work  for  the  measurement  portion  of  the 
Synthetic  Teammates  for  Realtime  Anywhere  Training  and  Assessment  (STRATA)  effort  of  DARPA’s 
DARWARS  program,  Aptima  developed  a  basic  capability  to  incorporate  observer-based  measurements. 

In  particular,  we  created  an  Application  Programming  Interface  (API)  to  link  observer-based  measures, 
collected  on  hand-held  tablet  computers,  to  the  system-based  measures.  The  observer  assessment  web 
service  application  at  the  heart  of  this  work  is  a  means  to  communicate  observer  based  measurements  to  the 
performance  measurement  engine.  As  such,  this  work  provides  the  basic  capability  to  have  both  systems- 
based  and  observer-based  measures  in  a  common  framework  to  allow  computation  when  needed  and 
display  through  eventual  After  Action  Review  tools.  The  API  and  Installation  procedures  have  been 
previously  delivered  (Ayers  &  Diedrich,  2006;  Kudzma,  Ayers,  &  Diedrich,  2006).  Below,  we  briefly 
describe  accomplishments  related  to  the  current  work  for  the  STRATA:  Observer-based  Measurement 
Agent  Research  Support  project,  which  provided  a  small  enhancement  to  the  observer-based  measurement 
integration  work. 

Summary  of  Technical  Accomplishments 

As  part  of  the  present  effort,  Aptima  enhanced  and  demonstrated  observer-based  measurement 
capabilities  to  include  time  correlation  with  HLA  events,  generalization  of  question  types,  and  further 
integration  of  automatic/observer  measurement  components.  Related  to  this  work,  in  Appendixes  I  and  II 
we  provide  updated  versions  of  the  API  and  installation  instructions.  More  specifically,  our  work 
accomplished  the  following  items: 

■  Correlation  of  timestamps  of  observer  measures  with  the  timestamps  of  HLA  events.  Ultimately, 
the  true  power  of  integration  of  systems-based  and  observer-based  measures  depends  on  using 
those  measures  in  a  manner  that  captures  their  relative  contribution  to  various  events.  For 
instance,  knowing  that  a  weapon  was  released  within  particular  parameters  might  be  especially 
powerful  if  it  is  also  known  that  a  particular  communication  occurred  at  the  same  time.  As  part 
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of  this  work,  therefore,  we  created  the  ability  to  correlate  observer  measures  with  timestamps  of 
HLA  events  by  marking  the  time  of  observations  and  storing  them  in  a  database.  This  capability 
enables  the  presentation  of  feedback  from  multiple  sources  over  time  and  with  respect  to  mission 
stage  during  After  Action  Review. 

■  Ability  to  compute  measures  that  have  both  automatic  and  observer-based  components.  In 
addition  to  the  capability  to  correlate  measures  across  time,  it  may  also  be  advantageous  to  be 
able  to  calculate  measures  that  have  both  automatic  and  observer-based  components.  Continuing 
with  the  previous  example,  for  instance,  it  might  be  advantageous  to  construct  a  higher-order 
measure  that  captures  performance  related  to  both  the  communication  and  the  weapons  release. 
Such  a  measure  could  provide  feedback  on  total  weapons  release  behavior,  which  could  then  be 
dissected  into  components  that  are  in  this  case  both  observer-  and  systems-based.  Thus,  the 
underlying  performance  measurement  architecture  was  expanded  to  manage  the  connection  to 
and  collection  from  multiple  data  sources.  In  the  past,  only  one  source  could  be  referenced  at  a 
time.  The  architecture  has  been  expanded  to  allow  multiple  sources  of  data  to  contribute  to  the 
overall  calculation  of  a  measure,  thus  enabling  eventual  calculation  and/or  assessments  of 
measures  across  measurement  types. 

■  Generalization  of  questions  and  probes  from  observer-based  tools.  Initial  work  on  integration 
of  observer  measures  supported  relatively  few  capability  measure  types  (i.e.,  item  response 
formats).  In  the  work  reported  here,  these  measure  types  were  expanded  to  handle  different 
formats  (rating,  yes/no,  or  written  observation).  Currently,  the  API  allows  you  to  update  and  add 
questions,  probes,  and  results  from  observer-based  tools.  The  system  allows  the  user  to  specify 
scale  for  the  measurement,  as  well  as  measurement  type.  In  total  this  capability  provides  a 
method  to  handle  a  variety  of  different  measurement  types  to  meet  the  needs  of  observers. 

■  Demonstration  of  capability.  Based  on  this  work,  we  demonstrated  the  capability  of  integration 
of  observer-based  measures  with  the  MOHPS  measurement  engine  in  July  2006  to  NAVAIR 
(Danielle  Merket).  In  this  case,  we  employed  Aptima’s  SPOTLITE  observer-based  measurement 
tool  to  demonstrate  that  an  observer  measure  collected  on  a  tablet  PC  could  be  conveyed  to  the 
MOHPS  measurement  engine.  In  addition,  in  December  2007,  this  capability  will  once  again 
be  demonstrated  at  Pax  River  to  the  MH-60R  community,  using  Aptima’s  SPOTLITE  tool  with 
sample  observer  measures  developed  as  part  of  the  VIRTE  program  (Wiese,  Freeman,  & 

Jackson,  2006).  These  measures  will  be  taken  along  with  system-based  measures  for  the  MH- 
60R,  thereby  showing  the  ability  to  capture  various  sources  of  data  on  performance.  Note  that 
although  these  demonstrations  involved  Aptima’s  SPOTLITE  observer-based  tools,  other 
observer-based  tools  could  be  integrated  using  the  API  developed  here  (Appendix  I). 

Conclusions 

In  total,  the  work  reported  here  represents  a  substantial  step  forward  for  performance  measurement  and 
assessment  for  training.  By  providing  an  ability  to  collect  and  represent  both  systems-based  and 
observer-based  measures  in  a  common  format,  we  have  enabled  the  use  of  a  wide  range  of  feedback  for 
trainees  in  simulation-based  environments.  Not  only  can  complex  measures  be  taken,  but  moreover, 
observer-based  feedback  can  be  integrated  quickly  and  seamlessly,  bypassing  the  traditional  time 
associated  with  manual  processing  of  observations.  In  future  work,  we  plan  to  integrate  the  ability  to 
capture  self-report  measures,  thereby  providing  a  common  framework  for  a  variety  of  complementary 
assessment  techniques.  In  addition,  we  plan  to  develop  methods  to  effectively  create  measurement  plans 
across  measurement  types  in  order  to  plan  feedback  and  to  capitalize  on  these  various  measures  during 
After  Action  Reviews.  Collectively,  these  combined  methods  of  measurement  will  enable  feedback  that 
is  comprehensive  and  precise,  thereby  maximally  facilitating  training  effectiveness. 
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Appendix  I 

Observer  Assessment  Web  Service  Application  Programming  Interface 

The  purpose  of  this  document  is  to  provide  specification  for  an  Application  Programming  Interface  (API) 
to  link  observer-based  measures,  collected  on  hand-held  tablet  computers,  to  a  system  that  captures 
system-based  measures.  As  described  here,  the  observer  assessment  web  service  application  is  a  means 
to  communicate  observer  based  measurements  to  Aptima’s  performance  measurement  engine.  More 
specifically,  Aptima  has  developed  the  capability  to  link  observer-based  measures  into  its  Measurement 
Objects  for  Human  Performance  in  Simulations  (MOHPS)  framework,  developed  previously  with 
NAVAIR  and  PMA-205.  MOHPS  provides  an  overall  architecture  that  can  ultimately  encompasses  data 
capture,  measurement,  assessment,  diagnosis.  During  Action  Review,  After  Action  Review,  and 
configuration  functions  to  map  available  performance  measures  to  specific  training  instances  through 
Performance  Measurement  Objects  (PMOs). 

Below,  we  describe  the  process  through  which  measures  from  hand-held  tools  can  be  communicated  to 
the  performance  measurement  system.  The  system  was  developed  to  enable  connection  of  Aptima’s 
SPOTLITE  observer  measurement  tool.  However,  the  API  below  provides  the  ability  for  other  tools  to 
be  easily  integrated.  As  described  below,  the  basic  steps  are: 

•  Insert  an  observer  assessment  period  that  represents  a  unique  assessment  time  period  with  a  start 
and  end  date 

•  Insert  a  trainee  profile,  if  available,  to  attribute  measurement  instances  against 

•  Insert  measures  and  measurement  instances  within  the  unique  assessment  period 

Questions  regarding  use  of  this  API  should  be  addressed  to  Aptima  via  Jeanine  Ayers  or  Emily  Wiese, 
Aptima,  Inc.,  12  Gill  St.,  Suite  1400,  Woburn,  MA  01801,  781-935-3966, 
jayers@aptima.com,  ewiese@aptima.com. 
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ServiceObserver  Measure 


PMO  Engine  -  Observer  Measure  Service 

The  following  operations  are  supported.  For  a  formal  definition,  please  review  the  Service  Description. 

•  I  nsertObserverAssessment  Period 

Create  a  new  observer  assessment  period  and  attributes  for  a  specific  starting  date. 

•  InsertObserverAssessmentPeriodWith  End  Date 

Create  a  new  observer  assessment  period  and  attributes  for  a  specific  date  range. 

•  UpdateObserverAssessment Period  End  Pate 

Update  an  existing  observer  assessment  period  end  date. 

•  I  nsertPerforma  nee  Period 

Create  a  new  performance  period  and  attributes  for  an  observer  assessment. 

•  InsertTrainee 

Create  a  new  trainee  for  a  specific  observer  assessment  period. 

•  InsertMeasurement 

Create  a  new  measurement  for  a  specific  question  and  measurement  type. 

•  InsertMeasurementInstance 

Create  a  new  measurement  instance  and  observations  for  an  observer  assessment  period. 

•  U  pda  teMeasu  remen  tinsta  nee 

Update  an  existing  measurement  instance  and  observations. 

•  RemoveMeasurementInstance 

Remove  an  existing  measurement  instance  and  observations. 
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ServiceObserverMeasure  1 

Click  here  for  a  complete  list  of  operations. 

InsertObserverAssessmentPeriod 

Create  a  new  observer  assessment  period  and  attributes  for  a  specific  starting  date. 

ObserverResult  InsertObserverAssessmentPeriod 

(moduleName,  periodStartDate,  a  its,  trainees) 

In: 

Parameter 

I  Type 

I  Description 

moduleName 

String 

This  is  the  name  of  the  module. 
Allowable  types  are  A2A,  Attack 
Coordinator,  DTC  Chief,  Target 
Duty  Officer,  and  Third  Party. 

periodStartDate 

DateTime 

This  is  a  starting  date  and  time 
of  the  observer  assessment 
period. 

atts 

This  is  an  array  of  attributes  for 
ObserverAssessmentPeriodAttribute[]  observer  assessment  period. 

trainees 

Trainee[] 

This  is  an  array  of  trainees. 

Out; 

Parameter 

jlype 

I  Description 

ObserverResult 

ObserverResult 

This  is  the  result  of  the  web  method. 
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ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

InsertObserverAssessmentPeriodWithEndDate 


Create  a  new  observer  assessment  period  and  attributes  for  a  specific  date  range. 


ObserverResult 

InsertObserverAssessmentPeriodWithEndDate 

(moduleName,  periodStartDate,  periodEndDate,  atts,  trainees) 


In: 


Parameter 

[Type 

Description 

moduleName 

String 

This  is  the  name  of  the  module. 
Allowable  types  are  A2A,  Attack 
Coordinator,  DTC  Chief,  Target 
Duty  Officer,  and  Third  Party. 

periodStartDate 

DateTime 

This  is  a  starting  date  and  time 
of  the  observer  assessment 
period. 

periodEndDate 

DateTime 

This  is  an  ending  date  and  time 
of  the  observer  assessment 
period. 

atts 

ObserverAssessmentPeriodAttribute[] 

This  is  an  array  of  attributes  for 
the  observer  assessment  period. 

trainees 

Trainee[] 

This  is  an  array  of  trainees. 

Out: 


Parameter 


Description 


ObserverResult  ObserverResult  result  of  the  web  method. 
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ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

UpdateObserverAssessmentPeriod  End  Date 

Update  an  existing  observer  assessment  period  end  date. 

ObserverResult  UpdateObserverAssessmentPeriodEndDate 

( observer AssessmentPeriodld,  periodEndDate) 

In: 


Parameter 

jType 

1  Description 

observerAssessmentPeriodId 

long 

This  Is  the  unique  identifer  of  an  existing 
observer  assessment  period. 

periodEndDate 

DateTime 

This  is  an  ending  date  and  time  of  the 
observer  assessment  period. 

Out: 


Parameter  Type  Description 


ObserverResult  ObserverResult  This  is  the  result  of  the  web  method. 
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ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

InsertPerformancePeriod 

Create  a  new  performance  period  and  attributes  for  an  observer  assessment. 


ObserverResult  InsertPerformancePeriod 

(observer AssessmentPeriodId,  performancePeriodName,  a  its) 


In: 


Parameter 

Type 

1  Description 

This  is  the  unique  identifer  of  an 

observerAssessmentPeriodId 

long 

existing  observer  assessment 
period. 

performancePeriodName 

string 

This  is  the  name  of  the 
performance  period. 

atts 

PerformancePeriodAttribute[] 

This  is  an  array  of  attributes  for 
the  performance  period. 

Out: 


Parameter 


Description 


ObserverResult  ObserverResult  This  is  the  result  of  the  web  method. 


Ill 
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ServiceObserver  Measure 


Click  here  for  a  complete  list  of  operations. 

InsertTrainee 

Create  a  new  trainer  for  a  specific  observer  assessment  period. 

ObserverResult  InsertTrainee  (observer AssessmentPeriodId, 
job,  name) 

In; 


Parameter  Type  [Description 


observerAssessmentPeriodId 

long 

This  is  the  unique  identifer  of  an 
existing  observer  assessment  period. 

job 

string 

This  is  the  trainee's  job  title. 

name 

string 

This  is  the  name  of  the  trainee. 

Out; 

Parameter 

Type 

1  Description 

ObserverResult 

ObserverResult 

This  is  the  result  of  the  web  method. 
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ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

InsertMeasurement 

Create  a  new  measurement  for  a  specific  question  and  measurement  type. 

ObserverResult  InsertMeasurement 

( measurementQuestion  Text,  measurementTypeName ) 

In: 

Parameter_ jlype |  Description 

measurementQuestionText  string  This  is  the  question  that  is  being  measured. 

This  is  the  type  of  question  that  is  being 

measurementTypeName  string  measured.  Recommended  types  are 

LikertScale,  YesNo,  and  MultipleOption. 


Out: 

Parameter_ jType |  Description 

ObserverResult  ObserverResult  result  of  the  web  method. 
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ServIceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

InsertMeasurementlnstance 

Create  a  new  measurement  instance  and  observations  for  an  observer  assessment  period. 

ObserverResult  InsertMeasurementlnstance 

( observer AssessmentPeriodld,  measurementid, 
performancePeriodId,  timestamp,  obs) 

In: 


Parameter 

Type 

j  Description 

observerAssessmentPeriodId  long 

This  is  the  unique  identifer  of  an  existing 
observer  assessment  period. 

measurementid 

long 

This  is  the  unique  identifer  of  an  existing 
measurement. 

performancePeriodId 

long 

This  is  the  unique  identifer  of  an  existing 
performance  period. 

timestamp 

DateTime 

This  is  a  time  stamp  of  the  measurement 
instance. 

obs 

Observation  [] 

This  is  an  array  of  observations. 

Out: 

Parameter 

jlype 

I  Description 

ObserverResult 

ObserverResult 

This  is  the  result  of  the  web  method. 
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ServiceObserver  Measure 


Click  here  for  a  complete  list  of  operations. 

UpdateMeasurementlnstance 

Update  an  existing  measurement  instance  and  observations. 

ObserverResult  UpdateMeasurementlnstance 

(measurementinstanceld,  timestamp,  obs) 


In: 


Parameter 

jlype 

1  Description 

measurementinstanceld 

long 

This  is  the  unique  identifer  of  an  existing 
measurement  instance. 

timestamp 

DateTime 

This  is  a  time  stamp  of  the  measurement 
instance. 

obs 

Observation  [] 

This  is  an  array  of  observations. 

Out: 

Parameter 

jlype 

1  Description 

ObserverResult 

ObserverResult 

This  is  the  result  of  the  web  method. 
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ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

RemoveMeasurementInstance 

Remove  an  existing  measurement  instance  and  observations. 

ObserverResult  RemoveMeasurementInstance 

(  measurementinstanceld) 


In: 


Parameter 

llype 

1  Description 

measurementinstanceld 

long 

This  is  the  unique  identifer  of  an  existing 
measurement  instance. 

Out: 

Parameter 

jlype 

I  Description 

ObserverResult  ObserverResu It  This  is  the  result  of  the  web  method. 
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ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

Observation 

Complex  type  for  the  observation. 


Name 

jlype 

1  Description 

Value 

String 

This  is  the  value  of  an  observation. 

DataType 

string 

This  Is  the  data  type  of  the  observation  value. 
Recommended  types  are  string,  bool,  int,  long, 
and  float. 

Sen/iceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

ObserverAssessmentPehodAttribute 

Complex  type  for  the  observer  assessment  period  attribute. 

Name_ jlype |  Description 

AttrlbuteName  string  This  Is  the  name  of  an  attribute. 

AttributeValue  string  This  is  the  value  of  an  attribute. 
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ServiceObserverMeasure 

Click  here  for  a  comolete  list  of  ooerations. 

ObserverResult 

Complex  type  for  the  result  of  the  web  method. 

Name 

Type 

Description 

StatusFlag 

boolean 

This  is  the  status  flag  for  the  result  of  the  web 
method.  The  flag  Is  equivalent  to  true  if  the 
status  Is  okay  and  false  If  it  is  not  okay. 

Value 

object 

This  Is  a  value  for  the  result  of  the  web 
method  when  the  status  flag  Is  equivalent  to 
true.  This  value  is  equivalent  to  null  when  a 
value  is  not  a  necessity. 

Description 

string 

This  is  the  description  of  the  value  when  the 
value  is  not  equivalent  to  null. 

Message 

string 

This  is  an  error  message. 

1  ServiceObserverMeasure 

Click  here  for  a  comolete  list  of  ooerations. 

ObserverResult 

Complex  type  for  the  result  of  the  web  method. 

Name 

Type 

Description 

StatusFlag 

boolean 

This  is  the  status  flag  for  the  result  of  the  web 
method.  The  flag  is  equivalent  to  true  if  the 
status  Is  okay  and  false  if  it  is  not  okay. 

Value 

object 

This  is  a  value  for  the  result  of  the  web 
method  when  the  status  flag  is  equivalent  to 
true.  This  value  Is  equivalent  to  null  when  a 
value  is  not  a  necessity. 

Description 

string 

This  is  the  description  of  the  value  when  the 
value  is  not  equivalent  to  null. 

Message 

string 

This  is  an  error  message. 
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ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

Trainee 


Complex  type  for  the  trainee. 

Name 

jlype 

1  Description 

Job 

String 

This  is  the  trainee's  job  title. 

Name 

string 

This  is  the  name  of  the  trainee. 

ObserverAssessmentPeriodId 

long 

This  is  the  unique  identifer  of  an  existing 
observer  assessment  period. 

ServiceObserverMeasure 


Click  here  for  a  complete  list  of  operations. 

PerformancePeriodAttribute 

Complex  type  for  the  performance  period  attribute. 


Name 

|Type 

1  Description 

AttributeName 

String 

This  is  the  name  of  an 

attribute. 

AttributeValue 

string 

This  is  the  value  of  an 

attribute. 
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Example  Program  and  Integration  Steps 


Requirements; 

1 .  Java  JDK  1 .4  or  greater  (http://java.sun.com/) 

2.  Apache  Axis  version  1.2  (http://ws.apache.oru/axis/) 

3.  Access  to  http://pmoengine.aptima.com 

Instructions: 

1.  Download  wsdl  file 

a.  Long  on  as  any  user  to  http://pmoengine.aptima.com 

b.  Navigate  to  URL  http://  pmoengine.aptima.com  /services/ObserverMeasure?wsdl 

c.  Select  File->Save  As  (the  default  filename  som.xml  work  fine)  to  save  the  wsdl  to  your  local  machine. 

2.  Generate  service  stubs  and  Java  classes 

a.  Add  all  jar  files  included  in  the  Axis  download  (%AXIS_HOME%/lib)  to  your  class  path. 

b.  Navigate  to  the  location  of  the  downloaded  wsdl  (som.xml)  from  a  console  window. 

c.  Run  the  command:  java  org.apache. axis,  wsdl  WSDL2Java  som.xml 

This  will  create  two  directories,  com  and  org,  which  will  contain  all  of  the  code  necessary  to  execute  the 
Observer  Assessment  WebServices.  Note:  other  command  switches  for  WSDL2Java  can  be  added. 
Only  the  default  usage  is  shown  here.  Consult 

http://ws. apache. ()rg/axis/iava/reference.html#WSDL2JavaRefercnce  for  more  information. 

3.  Using  the  WebServices 

a.  Create  a  new  Java  project  using  an  IDE  of  your  choice. 

b.  Add  the  generated  files  from  step  2  (com  and  org  directories)  into  the  project. 

c.  Make  sure  the  entire  axis  jars  are  added  to  the  classpath. 

d.  Begin  using  all  the  methods  as  defined  by  the  Observer  Assessment  interface.  These  methods  will  be 
defined  in  the  pmoengine.java  generated  file  in  package 


STF-^ATA:  OfiS(MV(^r-hnsn  Mf\'isuromoiit 
Fin.'il  R(^poft 


'  2006.  Aptiniri.  Inc. 


Aptima  ,  Inc. 


www.aptima.com 


Test  Program 

//this  method  returns  a  ServiceObserverMeasure  interface 

public  ServiceObserverMeasureSoap  getObserverMeasureService()  { 

ServiceObserverMeasureLocator  observerMeasureServiceLocator  =  new 
ServiceObserverMeasureLocator{); 

ServiceObserverMeasureSoap  observerMeasureSoapBindingStub  =  null; 


try  { 

ObserverMeasureSoapBindingStub  = 

observerMeasureServiceLocator.getServiceObserverMeasureSoapO; 

} 

catch  (Exception  el)  { 
e  1  .printStackT  race(); 

} 

return  observerMeasureSoapBindingStub; 

} 


public  NetworkSpotliteTestO  { 

ObserverResult  result  =  null; 

ServiceObserverMeasureSoap  soapService  =  this.getObserverMeasureService(); 
Calendar  rightNow  =  Calendar.getlnstance(); 

Observer AssessmentPeriodAttribute  atts  =  new  Observer AssessmentPeriodAttribute(); 

atts.setAttributeName(**syllabus*’); 

atts.setAttributeValue(”low  slow  flyer”); 

ObserverAssessmentPeriodAttribute  data||  =  {atts}; 

‘ry  { 

ObserverResult  result  = 

(ObserverResult)soapService.insertObserverAssessmentPeriod(”  A2A”, rightNow, a  Attrs); 

1 

catch  (Exception  e2)  { 

e2.printStackT  race(); 

} 

} 
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WSDL 

<wsdl:derinUions  targetNamespace=’’ http://PIVIOEngine.aptima.com**> 

<wsdl;documentationxb>PMO  Engine  -  Observer  Measure  Service</bx/wsdl:documentation> 

<wsdl:types> 

<s:schema  elementFormDefault=**qualiried**  targetNamespace=** http://PMOEngine.aptima.com**> 
<s:element  name=**InsertObserverAssessmentPeriod**> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs=**0**  maxOccurs=**r*  name=**moduleName**  type=**s:string**/> 

<s:element  minOccurs=**r*  maxOccurs=**r*  name=**periodStartDate**  type=**s:dateTime**/> 

<s:element  minOccurs=**0**  maxOccurs=**r*  name=**atts**  type=**tns:ArrayOfObserverAssessmentPeriodAttribute**/> 
<s:element  minOccurs=**0**  maxOccurs=**r*  name=**trainees**  type=**tns:ArrayOfTrainee**/> 

</s:sequence> 

</s:complexType> 

</s:element> 

<s:complexType  name=**ArrayOfObserverAssessmentPeriodAttribute**> 

<s:sequence> 

<s:element  minOccurs=**0**  maxOccurs=**unbounded**  name=**ObserverAssessmentPeriodAttribute**  nillable=**true** 
type=**tns:ObserverAssessmentPeriodAttribute**/> 

</s:sequence> 

</s:complexType> 

<s:complexType  name=**ObserverAssessmentPeriodAttribute**> 

<s:complexContent  mixed=**false**> 

<s:extension  base=**tns: BusinessObject**> 

<s:sequence> 

<s:element  minOccurs=**0**  maxOccurs=**r*  name=**AttributeName**  type=**s:string**/> 

<s:element  minOccurs=**0**  maxOccurs=**r*  name=**AttributeVaIue**  type=**s:string**/> 

</s:sequence> 

</s:extension> 

</s:complexContent> 

</s:complexType> 

<s:complexType  name=**BusinessObject**  abstract=**true**> 

<s:sequence> 

<s:element  minOccurs=**l**  maxOccurs=**l**  name=**ld**  type=**s:long**/> 

</s:sequence> 

</s:complexType> 

<s:complexType  name=**Trainee**> 

<s:complexContent  mixed=**false**> 

<s:extension  base=**tns:BusinessObject**> 

<s:sequence> 

<s:element  minOccurs=**0**  maxOccurs=**r*  iiame=**Job**  type=**s:string**/> 

<s:element  minOccurs=**0**  maxOccurs=**l**  name=**Name**  type=**s:string**/> 

</s:sequence> 

</s:extension> 

</s:complexContent> 

</s:complexType> 

<s:complexType  name=** ArrayOfT rainee**> 

<s:sequence> 
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<s:element  minOccurs='’0’’  maxOccurs=’'unbounded"  name='’Trainee"  nillable=’*true"  type=”tns:Trainee’'/> 

</s:sequence> 

</s:complexType> 

<s:elenient  name=”lnsertObserverAssessmentPeriodResponse”> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs="0”  maxOccurs=”r'  name=''lnsertObserverAssessmentPeriodResult’'  type='’tns:ObserverResult”/> 
</s:sequence> 

</s:complexType> 

</s:element> 

<s:complexType  name=”ObserverResult"> 

<s:sequence> 

<s:element  minOccurs=”r’  maxOccurs=”r'  name=”StatusFlag”  type=’'s:boolean'*/> 

<s:element  mlnOccurs=”0”  maxOccurs=”r'  name=*'Value"/> 

<s:element  mlnOccurs=’'0”  maxOccurs=”l*'  name=” Description"  type="s:string"/> 

<s:element  minOccurs="0"  maxOccurs="r'  name=" Message"  type="s:string"/> 

</s:sequence> 

</s:complexType> 

<s:element  name="InsertObserverAssessmentPeriodWithEndDate"> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs="0"  maxOccurs="l"  name="moduleNanie"  type="s:string"/> 

<s:element  minOccurs="l"  maxOccurs="l"  name="periodStartDate"  type="s:dateTime"/> 

<s:element  niinOccurs="l"  niaxOccurs="l"  name="periodEndDate"  type="s:dateTinie"/> 

<s:element  niinOccurs="0"  maxOccurs="l"  name="atts"  type="tns:ArrayOfObserverAssessmentPeriodAttribute"/> 

<s:element  minOccurs="0"  maxOccurs="l"  name="trainees"  type="tns:ArrayOfTrainee"/> 

</s:sequence> 

</s:complexType> 

</s:elenient> 

<s:element  name="lnsertObserverAssessmentPeriodWithEndDateResponse"> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs="0"  maxOccurs="  1 "  nanie=" InsertObserver AssessmentPeriodWithEndDateResult" 
type="tns:ObserverResult"/> 

</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  name="lIpdateObserverAssessmentPeriodEndDate"> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs="l"  maxOccurs="l"  name="observerAssessmentPeriodld"  type="s:long"/> 

<s:element  minOccurs="l"  maxOccurs="l"  name="periodEndDate"  type="s:dateTime"/> 

</s;sequence> 

</s:complexType> 

</s:element> 

<s:element  name="lIpdateObserverAssessmentPeriodEndDateResponse"> 

<s:complexType> 

<s:sequence> 

<s:element  niinOccurs="0"  maxOccurs="l"  name="lIpdateObserverAssessmentPeriodEndDateResult"  type="tns:ObserverResult"/> 
</s:sequence> 

</s:complexType> 
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</s:element> 

<s:eleinent  name=''InsertPerformancePeriod"> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs=”l'*  maxOccurs=*'l**  name="observerAssessmentPeriodld'’  type=’'s:long”/> 

<s:element  minOccurs="0''  maxOccurs=’'r’  name=”performancePeriodName”  type=”s:string”/> 

<s:element  minOccurs='’0''  maxOccurs=”r’  name="atts”  type="tns:ArrayOfPerformancePeriodAttribute''/> 
</s:sequence> 

</s:complexType> 

</s:element> 

<s:complexType  name="ArrayOfPerformancePeriodAttribute”> 

<s:sequence> 

<s;element  minOccurs=”0"  niaxOccurs=”unbounded''  name=’'PerformancePeriodAttribute”  nillable=”true” 
type=''tns:PerformancePeriodAttribute”/> 

</s:sequence> 

</s:complexType> 

<s:complexType  name="PerformancePeriodAttribute"> 

<s:complexContent  mixed=”false”> 

<s:extension  base='’tns:BusinessObject”> 

<s:sequence> 

<s:element  mlnOccurs=”0’'  maxOccurs=''r'  name=”AttributeName"  type="s:string''/> 

<s:element  minOccurs="0”  maxOccurs=”l”  name=''AttrlbuteValue"  type=”s:strlng”/> 

</s:sequence> 

</s:extenslon> 

</s:complexC'ontent> 

</s:complexType> 

<s:element  name="InsertPerformancePeriodResponse”> 

<s:complexType> 

<s:sequence> 

<s:elemcnt  minOccurs=”0"  maxOccurs=''r'  name=”lnsertPerformancePeriodResult"  type=’'tns:ObserverResult''/> 
</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  nanie='' InsertlVIeasurcment”> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs="0"  maxOccurs="r'  name="measurementQuestionText'*  type="s:stnng"/> 

<s:element  minOccurs=’’0''  maxOccurs=’’r’  name=''measurementTypeName”  type="s:string”/> 

</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  nanie=’' InsertlVleasurementResponse"> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs=”0"  maxOccurs=’*r'  name='’lnsertIVleasurementResult"  type="tns:ObserverResult"/> 
</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  name=''lnsertIVIeasurementInstance”> 
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<s:complexType> 

<s:sequence> 

<s:element  nilnOccurs=”r’  maxOccurs=”r’  name=”observerAssessnientPeriodId”  type='’s:long”/> 

<s:elenient  niinOccurs=”l”  maxOccurs="r*  name=”measurementld*’  type=’'s:long'*/> 

<s:elcmcnt  mlnOccurs=’’l "  maxOccurs=’'r’  name=”performancePeriodld'*  type=''s:long"/> 

<s:elcment  minOccurs=''r'  maxOccurs=”r'  name="timestamp”  type=”s:dateTime”/> 

<s:element  minOccurs=”0'’  maxOccurs=*'r'  name=”obs*'  type=''tns:ArrayOfObservation”/> 

</s:sequence> 

</s:complexType> 

</s:element> 

<s;coniplexType  name=’’ArrayOfObservation"> 

<s:sequence> 

<s:element  minOccurs=’'0"  maxOccurs=”unbounded"  name='’Observation”  nlllable="true”  type=”tns:Observation"/> 
</s:sequence> 

</s:complexType> 

<s:complexType  name=”Observation'’> 

<s:complexC'ontent  mixed="false"> 

<s:extension  base=”tns:BusinessObject"> 

<s:sequence> 

<s:elemcnt  minOccurs=”0”  maxOccurs=*'l  ”  name=" Value"  type="s:string"/> 

<s:element  minOccurs="0"  maxOccurs="l "  name="DataType"  type="s:string"/> 

<s:element  minOccurs="I"  maxOccurs="r'  name="lntVal"  type="s:int"/> 

<s:element  minOccurs="r'  maxOccurs="l "  name="TraineeId"  type="s:long"/> 

</s:sequence> 

</s:extenslon> 

</s;complexContent> 

</s:complexType> 

<s:element  name="lnsert!VIeasurementlnstanceResponse"> 

<s:complexType> 

<s:sequence> 

<s:clemeiit  mlnOccurs="0"  maxOccurs="l "  name="InsertlVleasurementlnstanceResult"  type="tns:ObscrverResult"/> 
</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  name="lIpdateMeasurementInstance"> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs="r'  maxOccurs="r'  name="measurementlnstanceld"  type="s:long"/> 

<s:element  minOccurs="r'  maxOccurs="l "  name="timestamp"  type="s:dateTime"/> 

<s:element  minOccurs="0"  maxOccurs="r'  name="obs"  type="tns:ArrayOfObservation"/> 

</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  name="llpdateMeasurementInstanceResponse"> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs="0"  maxOccurs="l"  name="lIpdateIVIeasurementlnstanceResult"  type="tns:ObserverResult"/> 
</s:sequence> 

</s:complexType> 

</s:element> 
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<s:element  name=*'RemoveMeasurementlnstance”> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs=”r'  niaxOccurs="r'  name="nieasurementlnstanceld"  type=”s:long”/> 

</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  name="RemovelVleasurementlnstanceResponse"> 

<s:complexType> 

<s:sequence> 

<s:clement  minOccurs=’'0'’  maxOccurs="r'  name="RcmoveIV1casurementlnstanccResult"  type="tns:ObserverResult''/> 
</s:sequence> 

</s:complexType> 

</s:element> 

<s:element  name=”InsertTrainee”> 

<s:complexType> 

<s:sequence> 

<s:element  minOccurs=”r'  maxOccurs=’'r’  name=”observerAssessmentPeriodld*'  type=’'s:long”/> 

<s:element  minOccurs="0*’  maxOccurs=''r’  name="job’'  type=”s:string''/> 

<s:element  minOccurs=”0”  maxOccurs=”r’  name="name’'  type=”s:string"/> 

</s;sequence> 

</s:complexType> 

</s:element> 

<s:element  name="lnsertTraineeResponse"> 

<s:coniplexType> 

<s:sequence> 

<s:element  minOccurs=''0”  maxOccurs=”r'  iiame="InsertTraineeResult''  type=”tns:ObserverRcsult’'/> 

</s:sequence> 

</s:complexType> 

</s:element> 

</s:schema> 

</wsdl:types> 

<wsd I : message  name="lnsertObserverAssessmentPeriodSoapln”> 

<wsdl:part  name=''parameters”  element=”tns:InsertObserverAssessmentPeriod''/> 

</wsdl:message> 

<wsdl:message  name='’InsertObserverAssessmentPeriodSoap()ut”> 

<wsdl:part  name=”parameters’'  element=’'tns:lnsertObserverAssessmentPeriodResponse"/> 

<7wsdl:message> 

<wsdl:message  name="lnsertObserverAssessmentPeriodWithEndDateSoapln'’> 

<wsdl:part  name=”parameters”  element="tns:lnsertObserverAssessment Period WithEndDate”/> 

</wsdl:message> 

<wsdl:message  name=’’InsertObserverAssessmentPeriodWithEndDateSoapOut"> 

<wsdl:part  name=”parameters”  element="tns:InsertObserverAssessmentPeriodWithEndDateResponse”/> 
</wsdl:message> 

<wsd I : message  name=''llpdateObserverAssessmentPeriodEndDateSoapln”> 

<wsdl:part  name="parameters”  element=”tns:l)pdateObserverAssessmentPeriodEndDate''/> 

</wsdl;message> 

<wsdl: message  name=''llpdateObserverAssessmentPeriodEndDateSoapOut'’> 

<wsdl:part  name="  para  meters”  element="tns:lIpdateObserverAssessmentPerlodEndDateResponse”/> 

</wsdl:message> 
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<wsdl:message  name=*’lnsertPerformancePeriodSoapln**> 

<wsdl;part  name=”  para  meters”  element=”tns:InsertPerformancePeriod”/> 
</wsdl:message> 

<wsdl:message  name=”InsertPerformancePeriodSoapOut”> 

<wsdl:part  name=” parameters”  element=”tns:lnsertPerformancePeriodResponse”/> 
</wsdl:message> 

<wsdl: message  name=”lnsertMeasurementSoapln”> 

<wsdl:part  name=”parameters”  element=”tns:lnsertMeasurement”/> 

</wsdl:message> 

<wsdl:message  name=”lnsertlVleasurementSoapOut”> 

<wsdl:part  name=”parameters”  elemeiit=”tiis:liisertIV1easuremeiitRespon$e”/> 
</wsdl:message> 

<wsdl:message  name=”InsertIVIeasurementlnstanceSoapIn”> 

<wsdl:part  name=” parameters”  element=”tns:lnsertIVIeasurementlnstance”/> 
</>vsdl:message> 

<wsdl:message  name=”InsertlVleasurementlnstanceSoapOut”> 

<wsdl;part  name=”parameters”  element=”tns:InsertIVIeasurementlnstanceResponse”/> 
</wsdl:message> 

<wsdl:message  name=”lIpdateMeasurementInstanceSoapln”> 

<wsdl:part  name=”parameters”  element=”tns:llpdateIV1easurementlnstance”/> 
</wsdl:message> 

<wsdl:message  name=”llpdateIVIeasurementlnstanceSoapOut”> 

<wsdl:part  name=”parameters”  element=”tns:lIpdateMeasurementlnstanceResponse”/> 
</wsdl:message> 

<wsdl:message  name=”RemovelVIeasurementInstanceSoapln”> 

<wsdl:part  name=”parameters”  element=”tns:RemoveMeasurementlnstance”/> 
<7wsdl:message> 

<wsdl:message  name=”RemovelV1easurementlnstanceSoapOut”> 

<wsdl:part  name=”parameters”  element=”tns:Remove!MeasurementlnstanceResponse”/> 
</wsdl:message> 

<wsdl:message  name=”lnsertTraineeSoapIn”> 

<>vsdl:part  name=” parameters”  element=”tns:InsertTrainee”/> 

</wsdl:message> 

<wsdl:message  name=”InsertTraineeSoapOut”> 

<wsdl:part  name=”parameters”  element=”tns:InsertTralneeResponse”/> 

</wsdl:message> 

<wsdl:portType  name=”ServiceObserver!VleasureSoap”> 

<wsdl:operation  name=”lnsertObserverAssessmentPeriod”> 
<wsdl:documentation> 

Create  a  new  <b>observer  assessment  period  and  attnbutes</b>  for  a  specific  starting  date. 
</wsdl:documentation> 

<wsdl:input  message=”tns:InsertObserverAssessmentPeriodSoapIn”/> 

<wsdl:output  message=”tns;lnsertObserverAssessmentPeriodSoapOut”/> 
</wsdl:operation> 

<wsdl:operation  name=”lnsertObserverAssessmentPeriodWithEndDate”> 
<wsdl:documentation> 

Create  a  new  <b>observer  assessment  period  and  attributes</b>  for  a  specific  date  range. 
</wsdl:documentation> 

<wsdi:input  message=”tns:InsertObserverAssessmentPeriodWithEndDateSoapIn”/> 
<wsdl:output  message=”tns:InsertObserverAssessmentPeriodWithEndDateSoapOut”/> 
</wsdl:operation> 
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<wsdl:operation  name=”lIpdateObserverAssessmentPeriodEndDate"> 

<wsdl:documentation> 

Update  an  existing  <b>observer  assessment  period  end  date</b>. 

</wsdl:documentation> 

<wsdl:input  message="tns:lIpdateObserverAssessmentPeriodEndDateSoapln"/> 

<wsdl:output  message="tns:l]pdateObserverAssessmentPeriodEndDateSoapOut”/> 

</wsdl:operation> 

<>vsdl:operation  name=”InsertPerformancePeriod”> 

<wsdl:documentation> 

Create  a  ne\v  <b>performance  period  and  attributes</b>  for  an  observer  assessment. 
</wsdi:documentation> 

<wsdl:input  message="tns:lnsertPerformancePeriodSoapln”/> 

<wsdl:output  message="tns:InsertPerformancePeriodSoapOut”/> 

</wsdl:operation> 

<wsdl:operation  name="InsertMeasurement'*> 

<wsdl:documentation> 

Create  a  new  <b>measurement</b>  for  a  specific  question  and  measurement  type. 

</wsdl:documentation> 

<wsdl:input  message="tns:InsertMeasurementSoapln"/> 

<wsdl:output  message=”tns:lnsertIVleasurementSoapOut”/> 

</wsdl:operation> 

<wsdl:operation  name=”lnsertIVIeasurementlnstance"> 

<wsdl:documentation> 

Create  a  new  <b>measurement  instance  and  observations</b>  for  an  observer  assessment  period. 
</wsdl:documentation> 

<wsdl:input  message="tns:lnsertIMeasurementlnstanceSoapln"/> 

<wsdi:output  message="tns:lnsertIVIeasurementlnstanceSoapOut''/> 

</wsdl:operation> 

<wsdl:operation  name="llpdate!Vleasurementlnstance"> 

<wsdl:documentation> 

Update  an  existing  <b>measurement  instance  and  observations</b>. 

</wsdl:documentation> 

<wsdl:input  message="tns:UpdateIVIeasurementlnstanceSoapln"/> 

<wsdl:output  message=”tns:lIpdateMeasurementlnstanceSoapOut”/> 

</wsdl:operation> 

<wsdl:operation  name="RemoveMeasurementInstance”> 

<wsdl:documentation> 

Remove  an  existing  <b>measurement  instance  and  observations</b>. 

</wsdl:documentation> 

<wsdl:input  message=”tns:RemoveMeasurementInstanceSoapln"/> 

<wsdl:output  message=”tns:Remove!VleasurementInstanceSoapOut”/> 

</wsdl:operation> 

<wsdl:operation  name=" InsertT rainee'’> 

<wsdl:documentation> 

Create  a  new  <b>trainee</b>  for  a  specific  observer  assessment  period. 

</wsdl:documentation> 

<wsdl:input  message="tns:InsertTraineeSoapln"/> 

<wsdl:output  message="tns:InsertTraineeSoapOut”/> 

</wsdl:operation> 

</ wsd  I :  po  rtT  y  pe> 

<wsdl:binding  name=”ServiceObserverMeasureSoap''  type="tns:ServiceObserverIVIeasureSoap 
<soap:binding  transport="http://schemas.xmlsoap.org/soap/http”/> 

<wsdl:operation  name="lnsertObserverAssessmentPeriod'*> 
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<soap:operation  soapAction=’’http://PMOEngine.aptima.coin/lnsertObserverAssessmentPeriod"  style="document"/> 

<wsdl:input> 

<soap:body  use=*’literar'/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use=''literar'/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=”InsertObserverAssessmentPeriodWithEndDate''> 

<soap:operation  soapAction=’’http;//PMOEngine.aptima.com/lnsertObserverAssessmentPeriodWithEndDate”  style="document"/> 

<wsdl:input> 

<soap:body  use=”literar'/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use=*'literal’*/> 

</wsdl:output> 

</wsdl:operation> 

<>vsdl:operation  name='TIpdateObserverAssessmentPeriodEndDate”> 

<soap:operation  soapAction="http://PIV10Engine.aptima.com/lIpdateObserverAssessmentPeriodEndDate"  style="document''/> 

<wsdl:input> 

<soap:body  use=”literar’/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use="literar*/> 

</wsdl:output> 

</wsdl:operatlon> 

<wsdl:operation  name="lnsertPerformancePeriod”> 

<$oap:operation  soapAction=" http://PIV10Engine.aptima.com/lnsertPerformancePerlod"  style="document"/> 

<wsdl:input> 

<soap:body  use="literar'/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use="literar'/> 

</wsdl;output> 

</wsdl:operation> 

<>vsdl:operation  name="InsertMeasurement"> 

<soap:operation  soapAction="http://PlV10Engine.aptima.com/lnsert\leasurement"  style="document"/> 

<wsdl:input> 

<soap:body  use="literar’/> 

</wsdl:input> 

<wsdl;output> 

<soap:body  use="literal"/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name="InsertlVleasurementlnstance"> 

<soap:operation  soap Action=" http://PMOEngine.aptima.com/lnsertIVleasurementlnstance"  style="document"/> 

<>vsdl:input> 

<soap:body  use="literal"/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use="literal"/> 
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</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name="lIpdateMeasurementInstance''> 

<soap:operation  soapAction=’'http://PMOEngine.aptima.com/lIpdateMeasurementlnstance*'  style="document’’/> 

<wsdl:input> 

<soap:body  use="literar'/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use=”literar'/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=’'RemoveIVIeasurementlnstance”> 

<soap:operation  soapAction="http://PIV10Engine.aptima.coni/RemoveIVleasurementlnstance"  style=’'document'*/> 

<wsdl:input> 

<soap:body  use='’literal’'/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use=”literar'/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=’’ InsertT ralnee''> 

<soap:operation  soapActlon='’http://PlV10Engine.aptima.com/lnsertTrainee"  style=''document"/> 

<wsdl:input> 

<soap:body  use=''literar'/> 

</wsdl:input> 

<wsdl:output> 

<soap:body  use=”literar'/> 

</wsdl:output> 

</wsdl:operation> 

</wsdl:binding> 

<>vsdl:bmding  name=”ServiceObserverlVleasureSoapl  2”  type="tns:ServiceObserverIVIcasureSoap'’> 

<soapl2:bindmg  transport="http://schemas.xmlsoap.org/soap/http"/> 

<wsdl:operation  name="lnsertObserverAssessmentPerlod"> 

<soapl  2:operation  soapAction="http;//PIV10Engine.aptima.com/lnsertObserverAssessmentPeriod"  style="document"/> 

<wsdl;input> 

<soapl2:body  use="literar'/> 

</wsdl:input> 

<wsdl:output> 

<soapl2:body  use=”literar'/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name="lnsertObserverAssessmentPerlodWithEndDate”> 

<soapl2:operation  soapAction="http://PIV10Engine.aptima.com/lnsertObscrverAssessmentPeriodWithEndDate”  style="document"/> 

<wsdl:input> 

<soapl2:body  use=”literar'/> 

</wsdl:lnput> 

<wsdl:output> 

<soapl2:body  use="literar'/> 

</wsdl;output> 

</wsdl:operation> 

<wsdl:operation  name='’lIpdateObserverAssessmentPeriodEndDate''> 
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<soapl2:operation  soapActlon=''http://PMOEngine.aptima.coni/llpdateObserverAssessmentPeriodEndDate”  style=’'document"/> 
<wsdl:mput> 

<soapl2:body  use='*literar’/> 

</wsdl:lnput> 

<wsdl:output> 

<soap12:body  use=”literar’/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=*'lnsertPerformancePeriod”> 

<soapl2:operation  soapAction=’'http://PMOEngine.aptima.coni/InsertPerformancePeriod”  style=”document"/> 

<wsdl:input> 

<soapl2:body  use="llterar’/> 

</wsdl:input> 

<wsdl:output> 

<soapl2:body  use=”literar'/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=''lnsertIVleasurement”> 

<soapl2:operation  soapAction='’http://PIV10Engine.aptima.com/lnsertlMeasurement”  style=”document''/> 

<wsdl:input> 

<soapl2:body  use=*'literar*/> 

</wsdl:input> 

<wsdl:output> 

<soapl2:body  use="literar'/> 

</wsdl:output> 

</wsdl:operatlon> 

<>vsdl:operation  name="lnsertMeasurementInstance''> 

<soapl  2:operation  soap Action=” http://PlV10Engine.aptima.com/InsertlVIeasurementlnstance”  style=”document”/> 

<wsdl:input> 

<soapl2:body  use=”literar'/> 

</wsdl:input> 

<wsdl:output> 

<soapl2:body  use="literarV> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=”llpdatelMeasurementlnstance”> 

<soapl2:operation  soapAction=” http://PMOEngine.aptima.com/lIpdatelVIeasurement Instance”  style=”document”/> 

<wsdl:input> 

<soapl2:body  use=”literal”/> 

</wsdl:input> 

<>vsdl:output> 

<soapl2:body  use=”literal”/> 

</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=”RemoveMeasurementlnstance”> 

<soapl2:operation  soapAction=”http://PMOEngine.aptima.com/RemoveMeasurenientlnstance”  style=”document”/> 
<wsdl:input> 

<soapl2:body  use=”literal”/> 

</wsdl:input> 

<wsdl:output> 

<soapl2:body  use=”literal”/> 
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</wsdl:output> 

</wsdl:operation> 

<wsdl:operation  name=*'InsertTrainee”> 

<soapl2:operation  soapAction=" http://PIVIOEiigine.aptima.com/lnsertTrainee"  style="document"/> 

<wsdl:input> 

<soapl2:body  use="literar’/> 

</wsdl:input> 

<wsdl:output> 

<soapl2:body  use="literal"/> 

</wsdl:output> 

</wsdl:operation> 

</wsdl:binding> 

<wsdl:service  name="ServiceObserverIVIeasure"> 

<wsdl:documentationxb>PIVIO  Engine  -  Observer  Measure  Service</bx/wsdl:documentation> 

<wsdl:port  name="ServiceObserverMeasureSoap"  binding="tns:ServiceObserverMeasureSoap"> 
<soap:address  location="http://localhost/ObserverMeasure/ServiceObserverMeasure.asmx"/> 

</wsdl:port> 

<wsdl:port  name="ServiceObserverMeasureSoapl 2"  binding="tns:ServiceObserverMeasureSoapl 2"> 
<soapl2:address  location="http://localhost/ObserverMeasure/ServiceObserverMeasure.asmx"/> 

</>vsdl:port> 

</wsdl:service> 

</wsdl:derinitions> 
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Appendix  II 

Installation  Manual 


This  document  details  the  steps  necessary  to  configure  a  computer  to  run  the  Observer  Assessment  Web  Service 
application. 

These  instructions  assume  that  the  user  has  administrative  privileges  on  the  computer  that  the  software  will  be 
installed.  The  software  has  been  designed  to  run  on  a  Windows  operating  system.  If  you  have  any  questions  about 
the  installation  procedures,  please  contact  Jeanine  Ayers  at  Aptima,  Inc  (phone:  781-496-2489,  email: 
jayers@aptima.com). 


Operating  System  Requirements 

A  Windows  NT  based  operating  system  (NT,  2000,  XP,  2003)  is  required  to  run  the  Observer  Assessment  Web 
Service  software  and  database. 


Software  Requirements 

The  Observer  Assessment  Web  Service  software  requires  a  MySQL  database.  MySQL  is  an  open-source  database 
server  that  is  free  and  available  over  the  internet.  A  version  of  the  installation  software  for  MySQL  has  been 
included  on  the  distribution  CD  in  the  following  directory  structure: 


Z:\Required  Software 


The  Observer  Assessment  Web  Service  application  software  can  be  found  on  the  distribution  CD  in  the  following 
directory  structure: 


Z:\  ObserverMeasureWebSetup.msi 

This  installation  document  describes  in  detail  the  three  steps  that  a  user  must  execute  to  get  the  Observer  Assessment 
Web  Service  software  running  on  a  computer. 


I.  Install  MySQL  Server  5.0 

Unzip  the  contents  of  mysqI-5.0.27-win32.zip  file  in  the  Required  Software  folder  to  a  temporary 
folder. 

In  the  temporary  folder,  double  click  the  Setup.exe  file. 
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Press  the  “Next”  button  to  continue. 


Select  the  “Typical”  radio  button  option  and  press  the  “Next”  button  to  continue. 


AP-R- 13(^6 
2003.  A[)limn.  Inc,. 


STF^ATA:  Ohsorvnr-hnsn  Monsiiromont 
FinnI  Rc^x^rl 


33 


Aptima  .  Inc. 


www.aptima.com 


iS*  MySQL  Server  6.0  •  Setup  Wizard 


MySQL.com  Sign  Up  -  Setup  Wizard 


MySQL.com  Sign-Up 

Login  or  create  a  new  MySQL.com  account. 

Please  log  in  or  select  the  option  to  create  a  new  account. 

O  Create  a  new  free  MySQL.com  account 

If  you  do  not  yet  have  a  MySQL.com  account,  select  this 
option  and  complete  the  following  three  steps. 

O  Login  to  MySQL.com 

Select  this  option  if  you  already  have  a  MySQL.com  account. 
Please  specify  your  login  information  below. 

Email  address: 

Password: 


0  skip  Sign-Up 


[  Next  >  1  [  Cancel 


Select  the  “Skip  Sign-Up”  radio  button  option  and  press  the  “Next”  button  to  continue. 


.•;4 
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I  MySQJ.  Server  5.0  •  Setup  Wizard 


m 


Wizard  Completed 

Setup  hds  insidlling  NtfSQC  Server  5.0.  Cf>dc  Finsh  lo  e»i 

the  v^ir^rd. 


0  Configure  the  MySQi  Server  now 

Use  th^  ophom  to  geoerote  en  opt»^nized  MySQl  conftg  We, 
setup  d  V/indc/.'s  service  runrrng  on  a  dedicated  port  and  to 
set  the  pdss/.'ord  for  the  root  accotirtL 


MySQC 


I  ^  I 


Cjrcdl 


Check  “Configure  the  MySQL  Server  now”  and  press  the  “Finish”  button. 


MySQL  Server  Instance  Configuration  Wizard 


m 


t\ 

MySQL- 


Welcome  to  the  MySQL  Server  Instance 

Configuration  Wizard  1.0.8 


The  Configuraton  Wzard  wl  alow  you  to 
configure  the  MySQL  Server  5.0  server  nstartce. 
To  Contrue,  ckk  Next. 


Next  > 


I  OxKcr  I 


Press  the  “Next”  button  to  continue. 
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MySQL  Server  Instance  Configuration 

Confgure  the  MySQL  Secret  5.0  server  nst^nce, 

Plcwc  sdcct  a  configurabon  type. 


Detailed  Configuration 

Choose  this  configuraboo  type  to  aeate  the  optmai  server  setup  for 
ttemachoe. 


Standard  Configuration 

Use  thts  oriy  on  machnes  that  do  not  a^eady  ha\*e  a  MySQL  server 
nstatabon.  This  wi  use  a  gcrwal  ptrpose  conhguraton  for  the 
server  that  can  be  tuned  rnanualy. 


I  <Back 


I  Next  >  I  [  Cjncct  I 


Select  the  “Standard  Configuration”  radio  button  option  and  press  the  “Next”  button  to  continue. 


MySQL  Server  Instance  Configuration  Wizard 


MySQL  Server  Instance  Configuration 

Configure  the  MySQL  Sen.»er  5.0  server  instance. 

Please  set  the  Wndows  opbons. 


p]  Instal  As  Wifidows  Service 


Tho  is  the  recommended  way  to  run  the  MySQL  server 
on  Windonvs. 


Service  Name: 


[MySQL  ^ 

Laurxh  the  MySQL  Server  automabcaly 


Indudc  Bin  Oirectory  in  Windows  PATH 

Check  ths  opboo  to  ifxJjdc  the  drectory  contamng  the 
server  /dwt  executables  in  the  V/ndow’s  PATH  varvrWc 
so  they  can  be  caled  from  the  command  Ine. 


[  <Bi>ck 


i  Next  >  I 


I  Coned  I 


Check  “Install  As  Windows  Service”,  “Launch  the  MySQL  Server  automatically”,  and  “Include 
Bin  Directory  in  Windows  PATH”.  Press  the  “Next”  button  to  continue. 
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MySQL  Server  Instance  Configuration  Wizard 

X 

MySQL  Server  Instance  Configuration 

Configure  the  MySQL  Server  5.0  server  nstance. 

P5c95C  set  the  sccunty  OPtKJnS. 

I  I  Modify  Security  Settings 

r,vi 


ij- 'i  -cot  coccao-c;. 


Enab’o  root  access  froni  re^note  rp-achnes 


(  <Bxk  I  I  Next  >  I  [  Caned  j 


Uncheck  “Modify  Security  Settings”.  Press  the  “Next”  button  to  continue. 


MySQL  Server  Instance  Configuration  Wizard 


^tySQL  Server  Instance  Configuration 
Confi9uf«  the  MySQL  Server  5.0  server  instance. 

Ready  to  execute  ... 


O  ^epare  configuration 
o  Wnte  configuration  file 
O  StartservKe 

J  ‘<-7*  •  ‘ 

Please  press  [Execute]  to  start  the  configuration. 


I  <  Bode 


I  Execute  I  1  Cor>cel  | 


Press  the  “Execute”  button  to  configure  the  MySQL  Server  5.0  server  instance. 
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MySQL  Server  Instance  Configuration  Wizard 


MySQL  Server  Instance  Configuration 

Confgure  the  MySQL  Ser^'er  5.0  server  instance. 

Proccssng  conf^abcn ... 


Prepare  cenfi^aten 

Wmte  cenfiguraCon  file  {C’P»>ogr*m  Wtf^MyS<5l’M*rSQl  S«»v«r  S.0Vny.inr| 

Start  SCrVKC 

.  j  Ar<^'v 

Configuration  file  created. 

Windows  service  MySQL  instaled. 

Service  started  sucx^ssfully. 

Press  [Rnish]  to  dose  the  Wizard. 


<  00-:^:  I  Frwsh  |  Ccirr^r-' 


Press  the  “Finish”  button  to  close  the  wizard. 
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II.  Install  MySQL  Connector/ODBC  3.51 

Unzip  the  contents  of  mysql-connector-odbc-3.51.12-win32.zip  file  in  the  Required  Software  folder 
to  a  temporary  folder. 

In  the  temporary  folder,  double  click  the  Setup.exe  file. 


Press  the  “Next”  button  to  continue. 
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MySQL  Connector/ODBC  3.51  -  Setup  Wizard 


Setup  Type 

Choose  the  setup  type  that  best  suits  your  needs. 


Please  select  a  setup  type. 

©JriM!;;! 


*  Common  program  features  will  be  installed.  Recommended  for 
'U)  general  use. 

O  Complete 


*  0  All  program  features  will  be  installed.  (Requires  the  most  disk 


space.) 


O  Custom 


w 


I  0  Choose  which  program  features  you  want  installed  and  where  they 
will  be  installed.  Recommended  for  advanced  users. 


<  Back  [  Next  >  |  Cancel 


Check  the  “Typical”  radio  button  option  and  press  the  “Next”  button  to  continue. 


MySQL  Connector/ODBC  3.51  •  Setup  Wizard 


Ready  to  Install  the  Program 

The  wizard  is  ready  to  begin  installation. 


If  you  want  to  review  or  change  any  of  your  installation  settings^  click  Back.  Click  Cancel  to 
exit  the  wizard. 

Current  Settings: 

Setup  Type: 

Typical 


Destination  Folder: 


<  Back 


I  Install  I 


Cancel 


Press  the  “Install”  button  to  install  MySQL  Connector/ODBC  3.51. 
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MySQL  Connector/ODBC  3.51  -  Setup  Wizard 


Wizard  Completed 


MySQL 


Setup  has  finished  installing  MySQL  Connector/ODBC  3.51. 
Click  Finish  to  exit  the  wizard. 


Bad  ^  Finish  ]  Cancel 


Press  the  “Finish”  button  to  exit  the  wizard. 


III.  IIS  5.1 

This  must  be  installed  prior  to  installing  the  Microsoft  .NET  Framework  2.0.  Press  the  “Start” 
Taskbar  button.  Select  the  “Control  Panel”  menu  item.  Click  “Add  or  Remove  Programs.”  Click 
“Add/Remove  Windows  Components”. 


J1 
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Windows  Components  Wizard 


Windows  Components 

You  can  add  or  remove  components  of  Windows  XP 


T  0  add  or  remove  a  component,  click  the  checkbox.  A  shaded  box  means  that  only 
part  of  the  component  will  be  installed.  T  o  see  what's  included  in  a  component,  click 
Details. 

Components: 


□  ^Fax  Services 

3.8  MB  ^ 

□  Indexing  Service 

0.0  MB 

@  Internet  Explorer 

0.0  MB 

Q  5  Internet  Information  Services  (IIS) 

13.5  MB  ■ 

I  rn  MArv^nnmnnt  ^nrl  Mnnitnrinn  T  nnk 

2  n  MR 

Description:  Includes  Web  and  FTP  support,  along  with  support  for  FrontPage, 
transactions.  Active  Server  Pages,  and  database  connections. 

T otal  disk  space  required:  67.3  MB 

S  pace  available  on  disk:  1 07240. 2MB 


Retails... 


<  Back 


[  Next  >  ]  Cancel 


Check  “Internet  Information  Services  (IIS)”  and  press  the  “Next”  button  to  continue. 


Insert  the  Compact  Disc  labeled  “Windows  XP  Professional  Service  Pack  2  CD”  into  your  CD-ROM 
drive  and  the  press  the  “OK”  button”. 
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Windows  Components  Wizard 


Completing  the  Windows 
Components  Wizard 

You  have  successfully  completed  the  Windows 
Components  Wizard. 


T  0  close  this  wizard,  click  Finish. 


Back 


\  Finish  j 


Press  the  “Finish”  button  to  exit  the  wizard. 

Press  the  “Start”  Taskbar  button.  Select  the  “Control  Panel”  menu  item.  Click  each  of  the  following 
in  the  same  exact  order:  “Performance  and  Maintenance”,  “Administrative  Tools”,  and 
“Services”.  Right  Click  on  the  “IIS  Admin”  service  and  select  the  “Stop”  menu  item. 

IV.  Install  Microsoft  .NET  Framework  2.0 

Double  click  the  dotnetfx2.0-x86.exe  file  in  the  Aptima  Software  folder. 


4.^ 
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H?  Microsoft  .NET  Framework  2.0  Setup  ^ 


Welcome  to  Microsoft  .NET  Framework  2.0 
Setup 


TNs  wizard  wil  guide  you  through  the  installation  process. 


I  ^xt  >  I  Cancel 


1 

Press  the  “Next”  button  to  continue. 

1^'  Microsoft  .NET  Framework  2.0  Setup 

End-User  License  Agreement 


End-User  License  Agreement 

MICROSOFT  SOFTWARE  SUPPLEMENTAL  LICENSE  TERMS 
MICROSOFT  .NET  FRAMEWORK  2.0 

Microsoft  Corporation  (or  based  on  where  you  live,  one  of  Its  affiliates)  licenses  this 
supplement  to  you.  If  you  are  licensed  to  use  Microsoft  Windows  operating  system 
software  (the  "software*^,  you  may  use  tNs  supplement.  You  may  not  use  it  if  you  do 
not  have  a  license  for  the  software.  You  may  use  a  copy  of  this  supplement  with  each 
vaKdIy  licensed  copy  of  the  software. 


Print 


By  clicking  “I  accept  the  terms  of  the  License  Agreement"  and  proceeding  to  use  the 
product,  I  Indicate  that  I  have  read,  understood,  and  agreed  to  the  terms  of  the  End-User 
License  Agreement. 


[^|j2CC|^  the  terms  of  the 


<Back 


Install  > 


Cancel 


Read  the  end-user  license  agreement.  Check  the  “I  accept  the  terms  of  the  License  Agreement.” 
Press  the  “Install”  button  to  continue. 
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Press  the  “Finish”  button  to  exit  the  wizard. 


V.  Install  the  Observer  Measure  Service 

Double  click  the  ObserverMeasureWebSetup.msi  file  in  the  Aptima  Software\SOM  folder. 
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Observer  Measure  Service 


Welcome  to  the  Observer  Measure  Service  Setup 
Wizard 


Qlo 


The  installer  will  guide  you  through  the  steps  required  to  install  Observer  Measure  Service  on  your 
computer. 


WARNING:  This  computer  program  is  protected  by  copyright  law  and  international  treaties. 
Unauthorized  duplication  or  distribution  of  this  program,  or  any  portion  of  it,  may  result  In  severe  civil 
or  criminal  penalties,  and  will  be  prosecuted  to  the  maximum  extent  possible  under  the  law. 


Cancel 


I . tjext'> . I 


Press  the  “Next”  button  to  continue. 


Observer  Measure  Service 


Select  Installation  Address 

The  installer  will  install  Observer  Measure  Service  to  the  following  web  location. 

T 0  install  to  this  web  location,  click  "Next".  T o  install  to  a  different  web  tocation,  enter  it  below. 

Site; 

[Default  Web  Site  [  I^isk  Cost... 

Virtual  directory: 
jObserverMeasure 


Cancel 


<  Back 


[  Hext  >  I 


Do  not  change  the  default  for  Site  and  Virtual  Directory.  The  default  for  Site  should  equal  “Default 
Web  Site”  and  the  default  for  Virtual  Directory  should  equal  “ObserverMeasure”.  Press  the  “Next” 
button  to  continue. 
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Observer  Measure  Service  (^1  n  ^ 


Confirm  Installation 

The  installer  is  ready  to  install  Observer  Measure  Service  on  your  computer. 
Click  "Next"  to  start  the  installation. 


Cancel 


<  fiack 


\  tiext  >  I 


Press  the  "Next"  button  to  continue. 


Press  the  "Close"  button  to  exit  the  wizard. 
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